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54) MOVING IMAGE PROCESSING METHOD 

57)Abstract 

^ROBLEM TO BE SOLVED: To improve the visual recognition by correcting a motion vector 
)btained at moving image compression into a vector representing a motion between consecutive 
rames and detecting an image of a frame satisfying a prescribed condition for a degree of 
iispersion in a frame generated next as a cut of a moving image. 

SOLUTION: Moving image data are stored in a storage section 1 04 and a cut detection section 
04 detects a cut already and information to be divided into a shot is provided. The user selects 
low a moving image is to be divided into scenes, by using what image. When a frame is selected 
ind divided into scenes, a similar image retrieval section 107 detects them to be plural similar 
mages. A scene information generating section 106 divides plural shots into scenes by using a 
rame discriminated to be a similar image as a border. A scene information generating section 
06 divides plural shots into scenes, bordering the frame decided to be a similar image. When the 
lame scene is discriminated, it is stored in a storage section 104 and plural frames being similar 
Tiages are defined by a link generating section 108. 
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^Bc^tiiL. :^yV\^X^m.Whtl^iy3^yh:^tl^it 
V— ASr— KS^^i^-So iyByh(DiXmyi^—^ 



i^hh:^^cmm^i^x-ox^m^tif-i^(o^. mi^z^ 

a y hco^m(Dy U-J>.:^m^:JjmfJ:if^miKX^ 

mi e 1 5 -e^^^^xfcv— >coftS:7 v— i^co 5 
o^riliRL. >ctj^;;-r§iy— vco^^cov/a ^c7:)— 
3 y h(DiXm:^^—-^'tmiK'r^ ^(DiyByh\^M 
[0 0 8 1 ] g.^Ji-Cfiv'— >'coft«:7 — 

>^ V— A^— K^-l^TV^f^;^^. mi^i^B y h(D~W^ff 

[oo8 2]m^ii. i^v:^i:i±x(DiyB y h(Dixmy 

[0 0 8 3] ^^->?-t>:7^^S^^W:^^^^ib^V^Ttt. il 

TV#7B.^V^< o;0^je^bT— ocT^liMffty'^— ^ t LT 
[0 0 8 4] S/-->^^fimt-S5:>-— it L;^^ 

•So 

[0 0 8 5] }ikm\z.n.tz.mmm(D^*^hfj^m(Dm^^^ 

[0 0 8 6] m—cDmMm2) m^. -^m^nw,—(o 
-r 5 )fe { - o v ^ T -r 5 o 



(10) 
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[0 0 8 7] tettas 104 izmm-^titzmmiAy'—-^ 

9]?^^^5->3 s/ hw^-a-fii/— >-ft$g^fcfi5c;^l 0 6{cj; 

mm^f—^' 1 1 ttcteitas 104 (cfeit^tt^» 
[0 0 8 8] —:>(D-^~^ik\^^\^. m^skm'&cD^m. 

5„I1117f, 3 0 3f47V— A 3 0 1 

hMz.wsm^^7T^-t^) y-^ . 3 0 4HP'i/— A3 0 2 

}-?Sbtufc»M^»y >'iJ'-t?fcS„ ^fc. 3 0 5(17 
1^— 3 0 1 S:^— B*^ir b-CV— :/^S^JLfci:^^D— 
o(Ov'— V^^L. 3 0 6 (±7 A 3 0 2 t L 

>-ttfg(4^— B*jfe i: M»<3tt TIB® ^ irhi^atj: h f£ 

V\ 

[0 0 8 9] mWmm.^mU 107 (±^-CCD'>a h;ei^ 

hm^^in^f^^-^^^^m^-tx^xmMmkm^ 
tl.Tv^5»^^c«, ^fi^^~t\^xmum^(Diikmii 

[0 0 9 0] JJAicO^Sc^t^ioT. W^(Oiy—:y^(D 



[0 0 9 1 ] mzL(r:>mMm'^^ iJ^T. *^PJt7:>Sffi^J 

[0 0 9 2] *^ffi^Jt-^o^v^T^l. w&MW^mn \ o 

rcT^i:^. jtbK^tb^ ~o(;)v/3 
fasti. 'Pf);ifi. [Wl— c7)v-3 :y h(-'g-itb^:7^— 

1 0 6 nmumi^^mm i o ? ;^)-ecowaLfc 
t-fe»g«i 0 4te:t£»t-^o i^-^nmtMci^mc^^ 

b< j^-^^-/-^— , TKu;^;, K^(r 

[0 0 9 3] ^i|x.a\ ^P^-CJif^^tLfcv^— >- ^> 

^V^fK^K^-r^r irt^J: 19. v^3 :y ^;0^^^'■^?5^7:>^/-- 
^--i^i^wioomm^^i^timmmxh^o >-3 :y b 4 o 

1 ^^—t \^X9i%l^tii&(D^>B y V t(DmU&t^A 0 
7-efo5o v^3 h 4 0 2 — 4 0 5 flSMSid^L^VMiS 
4 0 8 ?rMx.TV^^£7?-C|^— >^i:¥iJ^^tiS;5S. 
3 :y N4 0 6 t^^ttWMS;*^ l ^ VMS J; 19 t^g:V^/h*. 
[Wl — CO t i V ^ t ¥ IJ S ^ § o 

[0 0 9 4] v/->tf$R;^^^j5fe^tL/t^fi. ^-(Dm:^ 
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[0 0 9 5] (m—commm4) :^mm(Dm—(D^Mm 

4tt. El 9(D:7'D:yi:'Elwri:<«^-r5r.i:{-J;f? 
Il^$ti.5„ 5:^ • ->:^5}?7^^twa5 5 0 1 iJjiifjft^ 

U-r ^!j;?L(iffl^^a^^B 4 8 ^mM±m:k^ i M 

- 5 ^|WI 1 T - 7 {^#^ $ tb-C V ^ S ^ tt 5 

[0 0 9 6] ^^lil^ttl^§|5 5 0 3{liblil^<^)>t';4^b# 

[0 0 9 7] mt LT. ;^#a»?ft'^;ass[jjif^7^' 

[0 0 9 8] r (oi; 5 **M^sjroii)iif^^a 
5 0 3;dS5l#^-t-5„ rti-fiKiii^T""— ^ t t-hlz.mm^ 

[0 0 9 9] ^(Dfzi^. i-^my\^~j^(o^i)^hx^nm. 



hhX^^, 

[0100] L-fz-y I/— A t> L < {43t^:?[J;0S*iJ 

^-rso h\^<ii. mm.$fhtzyu~j:.h\^<nx^m 
t^(Dmzm^^tix^^iyu—M^hL-< {±35:*?iJi:ro 

®sr3itRLTt5#, m^'fxmy i^—j^nm^xmA^cm 

•So 

[0101] :X^mi$.^mU 5 0 3 (cttfijfl|#(Dfg^(:: 

[0 10 2] ^^(T?'^'— A(73Sbil|ittC*3V^X. / 

'»-y^^u^^tyy u—j^^mmi^. —%m^^-^riii. 
^^(om. Mff:>j^m(Di^-^:iiy—>^tzii-^misi^thxm 

^ $ i± T V ^ 5 « ® CO 7 1/ — A ;5 s # < * ^ $ 5 r ^ { 
[0 10 3] ^^:c7)mm;a5Rrtg;:e«-^(::!4^^^tt/c3t 

So mM\c:io\,^x^^(Dn^^-d^m^^tix\^^ 

h.{4\ y >'^tt$S;i-t>MiS7^-A«i?-Y A=3— te 

[0 10 4] Wjiij'f'tci-i'^/TK-x^ti.^ciii^T^ciK^ii^sp]- 
mx\ i)>-o^mmmmm-sjmfj:m^i>a^. mm^thtz 



(12) 
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[0 10 5] m^. con^te^^js 

[0 10 6] y v<Dixm-yu—j^<Dm 

-yV^m^. ^(D^y^ ^y V(D^(Dyu-~J>.^X\<in\^ 

[0 10 7] F[Jx.«. X(Dm(DTy':f<Dm^^fJ:^-<< 

[0108] rtz) J: 5 A^:3f-^:7 Ai: LT 

y VX\'X. ^ht^Xl^^b'&^hfhfz.iy B y VfyCD 

[0 10 9] :L(DX.o-^MX^yi^—J^(DWSVjm\^. 
^ y v(Dix^^m^m^\^mhth^h(Dx\t,fj:y^\ mm 

^R-r5f'26t:i^< PC^ffiSrfflV^^r ir;0Sprfg-efe5o 
[0 110] *»P^c7?S[jcov/3 y ViX^yu—J>^mU-)j 

^-fe-e&^o 1112 1 fir (7:)*o^S(7)^ti.^^bfc^>c7)i?fc 

■So 

[0 111] ^T. 'f-^«7V'-A;es*f£ilW$ixTV^Jie 
[0 112] -rT'tcSft?«bfc<t 513:. :5:*1tffi{4i^3 y 



[0 113] (^-(TD^ffiMro^am) *:^B^(Dli)Sj{fe^a 

[0 1 14] $6>{c, ?iJffl#;S5-tb6>^f'J^g fefrof- 
[0 115] (^H(73||J£W J^-^T. *»B^©I|H(D|S 

mm^mm^m-^^^xmm-r?>o mn^^if^tcmc^ 
liiTxi-^mse^fpm^-ri^MBi^fc-mnwim^^ 

[0 1 1 6] B2 2(4:*:^0^(D— *J£^J(;i1^i^6?*:{ty'' 
;5<:(7D^^^^i-|i!t;t;|gl-efe-5„ 110 1 f^Sbili 

1 0 iwftSfjffil 1 0 2(±. ii^, ifjW^fcjoit 
>-7^"5/i?;^j 1 9 9 3 ^ffi^'tf $Ril{B^^*^:*c^i#?» 

^fi* S D - 9 - 4 if~ ) „ 
[0 1 1 7] :^fc, iiW-T^ ^1^1 10 1 <7)*^T#^4, 

=ii^(o^n%<Dmmx\ ^(Du.Wi(Dmm^f^i:^^^t 
iif,m\m-t^-nm\ n^mmmm^^B.wm^ i e 

9 4-4 9/£t-) . ;$:^BJ(D«^;b-5':(':fcV^TttM<75 



(13) 
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[0 118] ^KT^^-a-. ^fl^tffc^ttMfft^^ 1 Ov--> 
^l^t bT^^b. 5 0 2 0 0;^-/ Nco^-g^ 

bTft:^-r5. Tiir^-efe^o «^c^->HryN ($)^V^fi 
: rfe#t|Srt- j:^g^^o/^>.^^(75^|^j 1 9 9 

3 ^m^mmLmm^^mmi^^mm.^mm. d - 4 9 

0) . 

[0119] tcWT^ :n > 1 1 0 1 2 ^TcffitltcS.^ 
^nT^i^tr"^ — ^/^if^cDllf®tcS;^^;h.6o ^i? 1 1 0 
3t^:^c7?;^7^;/ ^ft^;^'^^^tfci^. *^T#^r ^R]tr:St,t^T b 
*ofc>-3 :y h(7)#^5E^P^^-r'5o 1 1 0 3 

;a^WSlS^tb. g^^tb^o *A;^co>^3 ^> btc^bT 
fi. -?:t^i/3 :y h cO^giJ^^^-T 5 i:^'-r 6o 1 1 0 
3 _b(D5:^^'[f bTi <xh^^\ 

[0120] tLW^T-i ^ 1 1 0 1 tifttuffi 1 1 0 2 
4E^t,o. i^AT'r:^tir(7)4ffiSr^.$i;bT^{- Tt^ ^ 
[0121] [gl 2 2 -eti:tflijffi 1 1 0 4 t _bffi 1105 

4^fflV^TSiP^-r^o 

[0 12 2] h^mm^<D^n t (c^ott^iftfts 3 0 1 

M* (x, y) CORGBlB^fflV^T (r (x, y, 
t) , g (x, y, t) , b (x, y, t) ) t^t>\^ 

[0123] rtOir^, xy t^mcD. B#ffl^^>^}^0 

3 3 0 2 a x + b y + c t = d ^ 
(7)¥ffi3 3 0 2 J^^X?>mi^3 3 0 1 (7)»fE^_bffi3 3 0 

sic^m^-r^t^^^. mm (x, t) t-ROBft (r 

(x, (d — ax — ct)/b, t), g (x, (d — 
ax — ct)/b, t), b (x, (d — ax— ct) 
/b, t) ) ^fSH-r^r tTr©f^Sl;OS:^S$tb^. 

[0124] mm\^:^mm 3304 tcsf^-r 5 

a. mm (y, t) t^lRGBfe (r ( (d-by-c 
t)/a, y, t) , g ( (d-b y- c t) /a, 
y, t), b ((d-by-ct)/a, y, t))^ 

[0 12 5] ibiii^coA^ ^;5SitiSw. m^H-x:\ ®ffic^ 
;&_bBSr (x = 0, y = 0) t-ti^m^. ¥ffi 3 3 0 2 
£7:>alr/^ri: bTfi. _hffit^7?fbT Ty^Oo x, t 
fij . *-iIiJ®t::>EtbT rx=W, y, tW£Sj . i£® 



t-^bT Ty^Ho X, tttftKj , tEmmzMi^x 

[0 12 6] rcT:)^'^^. #T-r =i>ffiiJa{3:S.^^tL5® 

[0 12 7] m2 2l:ihif-:^Xmm^mir^o ^Li^T 4 
> 1 1 0 1 (D^m\zit,:tyiy^ ^ h 1 1 0 6 1 

1 0 7;^s^^^^^■rv^^o me.fl. #Bg^i 1 0 87^^ 

i:^Sr$*:frbT. ^tb^a^^Wb^^cBf^JcDT-Y >ffiijffitc>?f 

[0 12 8] *^-t--<^:^v^^v>in^ h^f^fi:^:*:?!. A 

«t7)^^ftJ 1 9 9 4^m^tf$BS{t^^»^A^t«?R^ 
m*, D-4 2 2/£i:% ttibtCloV^Tfl 

^^/^^j^^-ttHiffij 1 9 9 4^m^'[f$Ea{t^^%^*A# 
mm^mm, D- 2 8 9/^to . *ijffl*;a^fce5^^bi^H 

[0 12 9] V^-f^tDI^b-ftt-j^V^Tt. ^t7:):^yv^3i^ 

h * h s Ptr^T ^ o T m^^i^^^-t ^ 

fci o fcBf^ij CO ^:7^^v^rii^^ h*/ct±:$:^^i i o 

tti 1 0 7coj: roi 5t-:^:/v^^^ h 

1 1 0 6^X^i 1 0 7 ^m^-r^Mm-^. i^^Tb^^it 

m^l^X^^^^m-B-^^hm^X^ 

rc^ h 1 1 0 6-^5:?^l 1 0 7CO^^fCoV^T^l. ^Ijffl 

[0 13 0] :^^f ^S^fii^^Tbt >Lfl^T-r V 1 1 0 
mMmWiCO 1 :7 I/— A5r^^b/^V^{MIJffi£D^C0^:^tr, 

1 1 0 3^^:/i^aii7 h 1 1 0 6 A~c;iif^5rS^b 

xi,j:h\ ^tc. m2 8xnmmi^(Dmmxit.fj:<. ^ 

6 6 0 1 _bT\ fttrt ;^[R]. -r^^t^hm 2 8 

-lyf-m^iD^mmizmhth'r. mm^^mx:ty'i^:^^ h 

:^^^t^(D{iLUi^^1±l^X\^^r-:^^:^j:t^(Dmm^^^^^^ 
bTt^J:V\ 

[0131] m28 (Dm^r^n. ±Ecoi 5 ^c^^^-^kv^ 
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bfci;^^Srff^L:^c^^-efo5o h 1 1 0 6 A 

tc^/Si-^lb^^^fie 6 0 2 A. i^TlRl1«f-B, Oh 

Ai: C;a^f^C:^:/v>iii:^ N-efc^ r i bTV^/^< 
^fciii^tLfc::^:/^/^^ b 1 1 0 6 A~C^^5r ttci 

[0 13 2] [gl2 8C0J: 5^.^«^5r^«-r5r irt-J;o 

[0133] o^tc:, A£^$:T-f =3 1 1 0 1 Jb^fg^i" 
yi- 1 1 0 9 l^iLi^T-^ :=^>1101irp] CMSit-fc 

— y yi^ 110 9 XyLi^T^ ^ :/ 1 1 0 1 t7);&±ia 111 

mm(D^^m (P-itH) :^sj::pgl 1 0 5_btc:5l^m^tb§ 
J:5f:i*^^n§ (iljffil 1 1 m^l^m^tit^'ikm^ 

[0 13 4] ^l^ffi^tLfcBI® 1 1 1 1 tt. :tf — y^ui 
1 0 9;^)S^|^m^ttfc{i£a;6^b^^ irf^^-So fo^v^fl 

@b-CtictV\ ;&±i23 1 1 1 0 ±cD—.^.^AEm\^tB^~r 
tt-iULv^co-e. ;&_b3ai i i o tmm.:^m^wm 

_hiai 1 1 o±{cmm^T^i^t^.^.±^in^i^tc^^t 

[0135] m2 5 tm2 7tCfi. m2 2(DX ^ t^^^ 

i^^miR] tit,. mmm(omm:(of:ii6<Dmi'Fxh^ . ^> 

[0136] — ;^-yyn 1 0 9(;iJ:^51?fcfg^?r 

^x.7i<Tfc. mmmw±(Diin7s^^-^x,^-tx^m6^ 

\zmiM:^'^^Li^T 4 1 10 1 i:?l^abi$^^T 

W^SrS^^ibTt^< tr:^^v^^:L^$:T'Y 1 10 1 (iS< 
fttuffil 1 0 2{c^^^ti^ilj^^>H#railtTbT 



fllllffil 1 1 1 £^J: 5 t-^l^fflUf::a^Srf ^i^^^fl^cf: 
[0 13 7] ^l#ttiL*^(0^-t?:?t9(;^SiJ(7:)*^iir 

it^^m^^thx^'^^m^t^\i(Dmim^w^i'. ttw-T-i^ 

>1 1 O 1 (7)&§[liffiS:^{lF#^5^. ?H^R#^JtDS^Ill 

[0 1 3 8] g] 2 7 tl. [2 2 2 CD J: b f^m^-^rx 0 f^^ 
(S5 0 1) . K^iZ^tpr i:^^-e^^^tti^tt\ Ellffi 
zn>^iy^\ /^tO SrK^iAtF (S 5 0 2) . 

^:$Sv— >^(7:>5feIS"efcofc»^ (S 5 0 3) . 

^*:T-r^>^^{^^i-^J;5t-*{i-r^ (S 5 0 4) o 

i"^ (S 5 0 5) 3 iy—i^a:>^mit~m^i^3^yh(V^ 
mXhh^(DX\ S^ott^ (S 5 0 6) o 

[0 13 9] —Jj, ^(DyU--J^t^^i^-~>^(D^mXt^< 
Xhi^B y hOO^cmXh^t^m^ (S 5 0 7) . 5a{*T 

S:*^iA^ (S 5 0 8) . :?S:ott^ (S 5 0 6) o 
[0 14 0] (iy—>^^i^3 y h(D9EimXh^f'm 

'B'Xhs 'tbXf^'^^-:>fzm'^Xh) . :ty'iy^^ h^X 

:t':fiy::^^ h^X^lt. ^ivh^^^t(Diya ^y h^XMi^ 

:ic^^iLf*T-f =1 ^^tofiosiaf^tc^^i-^ ( s 5 o 9 , 

S510, s5ii)ort^>i:#, -x-^mw^^h^m^^ 

[0 14 1] $;^SiE5t 

[0142] tOiZ.^ 1 :7 j^^^fe^tt lif^T'i' ^ :y<DW 
^?ri#-^L (S 5 1 2) . ^IlJffif7^ll^{&^coV^T t . 
y i^t^MbT»^inx.^ (S5i3) « ii;^±t7^iiig 
^(Dyi — A < ^ * Tr^ o 



(15) 



#M^9 - 9 3 5 8 8 



[0143] ^AKOmm-^'^t.^ iLW-T^ 1 0 1(D 

fttuE 110 2 (DM^-^. <lWT-{ =3 > 1 1 0 1 (D^^ 

\^^7r^^tLti:^'fi>=^^ h 1 1 0 efn^n.mstmi^t U 

1 0 1 t^t5Hto->— >'^^t9MLIf^bTV^Tt J:v\ 

[0144] * fc, ^(DtLWT-^ :=! V 1 1 0 1 td-g-tp;^ 
ti. :^:/v?:i:^ h 1 1 0 6 tcov^rtl. ^(DtJ-y h\^X 

■So 

[0 14 5] 5/iS:ft:T-r ^VftWEt^SbMife* 



\h^-f. 1212 3CDJ;5^cCv'3 5/ h^iJ* 



[0146] (||Z.co^J£M(75?;!i*) Jii_hi5£B^ bfc J; 5 
[0 14 7] 

[0 14 8] 5^^l^(75Kjilf^^a^ttX-(i_hfa^ 



[[21Sroffi¥/£UiP^] 

[0 1 ] imm^<DW,-(omMm i w-W^^^iJSr^i-:/ 
[[212] *II?§B^{rds(tSg*^;<;s/ h»1^tU?P(D-«^ 
[Els] 3|s:fi^B^c7)ij)ir-<j? b^i^yp .^^©fjiP^El-efe 

■So 

^ KyK75^Jro|Il-efeS„ 

[0 7] *ii^H^(7?iii:fy[p]wtt)^^i? V)vhm-)5\^(om 

lEfb^-i^ h/K?)M11Bl-efc-5<, 

m 9 ] :^mmm(Dm^m'(tmt b#vMS^ttofcii*f* 



[El 0 ] ^mmm(Dm-(DmMm 2 <©-«fifei5-!i^^-t- 
[011] ifmmmnm—nmmm 3 {cjofj-si^ife:^/ 5/ 
[012] :^mmm(^w,—(r>m:mm(Dm^(nmw^^-r 

[01 3] :*:lii^BJ»^-CO|^ffi^>|l, 2, 3W«fife^ 

[014] if.mmm<DWim^(D v^^^^^mt v^-^^w 
<75tft0j0-es>5„ 

[015] ^M^e^coi/— K*^'73i5^!jcD0-rA)?)„ 

[016] :^mmm<n>'3 y h— K«^ro^J(730-efc 

•So 

[017] ifmmm<D^Wi^^~>^j^M<Dmmm-r^^^o 

[018] 3 {c*3{t5 

[019] ■^mmn<Dm—<DmMmA.(Dmi^^^-ry'^ 
2/^0-efcSo 

[02 0] *Ii^B^(75^-rosSJfe^j5(3:iott5^1l©t5i 

B^0T-&S„ 

[021] 2|s:iIBB^©M-CD^*feM 5 (C*5(t5^S(^tji 
0^0T'fc-5„ 

[02 2] ^iS^SPjcDS^^T^— ^-<— ;^coS:^:^fe{''» 

[02 3] ti&jfecg^'fftT^'— i?-<— ;^<D«^;^fe{c:'»5tt 
;ft0-efe5„ 

[0 2 4] *M*P^<^s*fiiT^"-i5'-<— 
0J -r 5 J5 ©«£;i;0 5 „ 
[02 5] *®^BjOB*{fe5= — i?-<— 

ffl0-!l^^-rSt;S;0-Cfe5o 
[02 6] ;*:ii^PJ<^§*:i*7^— i5'-<— ;^<D*^;^^tcDfiJ 

[02 7] if.m^m(Dm'k'f~-^^—:^(D^7ri^m^m: 
2 DCTgjs 11 mm^'^^^m^ 

5 iMi^-fk^ 2 2 B^^'^-fkS^^tHSP 

6 2 3 ttm^ 

7 yu~M.-y^^v 2 4 i^-fft^-ft;*^^!; 

8 ii^DCT^P 2 5 L#^^f^I^tt|&P 

9 ®b^-<i? h/ul^(±i^ 

1 0 0 mmm.'f-^AM'j- 
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10 1 mi^M V iA^^ 

102 y&i/h^^ttilHS 

10 3 ^^gp 

10 4 fait§p 

10 5 m^MMmw^ 

10 6 S^^g|3 

10 7 WfiJ(iil^^*^ 



10 8 y i/^it^gB 

110 1 3i#:T^ ^ > 

110 3 -> a h Sr:^i-:i? 

110 6 i^tii^tltz:^:fi?^i^ h 

110 7 tttii^ttfciS:^ 

110 9 ;{7 — yyu 

1111 ?l^tiJL*^$tLfclllffi 
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[1213] 



11 







_.. . 1 








j,10 12 



[04] 



[1215] 
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[1119] 




[1112 6] 
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